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This  report  describes  the  ccncoptj/of  "acoustic  area  assess¬ 
ment"  as  currently  practiced  at  AESD.  T*7he  product  of  an 
acoustic  area  assessment  is  a  calibrated  environmental  and 
acoustic  modeling  capability  relevant  to  a  specific  system  in 
a  specific  geographic  area.  Within  prescribed  resource  con¬ 
straints,  the  capability  combines  the  state-of-the-art.  in 
'modeling*  the  required  acoustic  parameters  with  the  relevant 
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environmental  inputs  required  by  the  acoustic  models.  A  ^model^ 
is  taken  in  its  most  general  sense  to  represent  an  interpolation 
and  extrapolation  from  known  results.  Predictions  based  upon 
the  models  are  accompanied  by  estimates  of  their  accuracy  to 
ensure  that  the  true  significance  of  inferred  system  performance 
can  be  estimated  by  the  systems  engineer. 

Acoustic  area  assessment  is  described  in  the  context  of  the 
LRAPP  measurement  program,  in  which  case  the  results  are  docu¬ 
mented  in  two  types  of  reports:  an  area-wide  summary  report 
which  assesses  the  acoustic  implications  of  the  measurements 
!  and  mode1  mg  effort  across  a  broad  class  of  systems;  and 
individual-system  assessment  reports  which  filter  the  data 
relevant  '..o  specific  systems,  and  develop  and  evaluate  the 
systim-oriented  acoustic  and  environmental  models.  ^'While 
acoustic  area  assessment  is  an  evolving  process,  "freezing"  it 
in  this  aocument  is  intended  to  familiarize  the  systems- 
engineering  community  with  the  type  of  information  available 
fro ■n  an  assessment,  to  convey  to  the  measurement  community  some 
of  the  modeling  needs,  and  to  stimulate  within  the  modeling 
I  community  a  dialogue  leading  to  improvements  in  the  process. 
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1.0 


INTRODUCTION 


The  successful  generation  of  meaningful  acoustic  inputs 
for  system-performance  analysis  requires  close  communica¬ 
tion  between  the  acoustician  (measurer  or  modeler)  and  the 
systems  engineer  (designer,  deployer,  or  analyst) .  Figure 
1-1  illustrates  the  basic  relationships  between  the  measure¬ 
ment,  modeling,  and  sy s tems-engineering  communities.  Models 
are  used  both  to  interpret  the  results  of  measurements  in 
terms  of  acoustic  implications  for  systems,  and  to  ensure 
that  the  needs  of  the  systems-engineering,  design  and 
analysis  community  are  anticipated  in  future  measurements. 

This  report  represents  an  attempt  to  strengthen  the  lines 
of  communication  by  describing  AESD's  approach  to  "acoustic 
area  assessment".  The  objective  of  an  acoustic  area  assess¬ 
ment  is  to  build  a  calibrated  environmental  acoustic  pre¬ 
dictive  capability  for  the  application  to  a  particular 
system  ir.  a  specific  area.  The  systems  engineer  is  then 
provided  with  predictions  of  the  desired  acoustic  parameters 
based  upon  a  mix  of  measurements  and  models  and  accompanied 
by  measures  of  the  prediction  accuracy. 

This  capability  has  been  generated  as  an  integral  part 
of  the  regional  systems  assessments  of  the  LRAPP  measurement 
programs.  Within  this  context  the  formulation  and  calibration 
of  acoustic  and  environmental  models  for  an  area  build  upon 
existing  models  and  data  bases,  relying  upon  the  LRAPP 
measurements  both  to  fill  critical  gaps  in  the  environmental 
model,  and  to  reduce  deficiencies  in  the  acoustic  models. 

By  simultaneously  addressing  an  area  from  the  viewpoint  of 
a  number  of  existing  and  potential  systems,  considerable 
duplication  of  effort  is  avoided,  and  an  area  acoustic 
capability  is  developed  for  future  systems  assessments  in 
addition  to  those  carried  out  by  LRAPP.  Even  without  the 
benefit  of  a  LRAPP  exercise  in  a  particular  area,  many  of 
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the  concepts  described  here  can  be  applied  to  produce  an 
acoustic  area  assessment  with,  presumably,  larger  uncer¬ 
tainties  . 

The  approach,  as  described  here,  is  somewhat  idealized, 
and  in  practice  has  been  considerably  reduced  in  scope  to 
conform  to  external  time  and  resource  constraints.  The 
accuracy  available  solely  from  the  present,  fully  automated 
models  is  insufficient  for  many  applications,  and  a  con¬ 
siderable  effort  must  be  devoted  to  developing  system- 
oriented  "models"  in  the  more  general  sense  described  sub¬ 
sequently.  For  example,  the  unconstrained  application  of 
this  approach  to  CHURCH  ANCHOR  and  SQUARE  DEAL  assessments 
would  require  6  months  and  1  year,  respectively,  of  four 
people  given  present  modeling  capabilities  versus  half  that 
amount  of  time  using  the  more  advanced  models  which  will  be 
available  in  a  year.  While  this  long  a  delivery  time  may  be 
unacceptable,  one  advantage  is  that  given  adequate  time, 
more  general  as  well  as  more  automated  models  can  be  devel¬ 
oped  for  future  use. 

It  is  hoped  that  this  report  will  accomplish  several 
objectives : 

1.  to  acquaint  the  systems-engineer ing  community 
with  the  type  of  information  available  fr or 
an  acoustic  area  assessment; 

2.  to  familiarize  those  involved  in  the  planning 
of  acoustic  measurements  with  the  capabilities 
and  needs  of  these  models,  ensuring  experimental 
design  more  attuned  to  the  needs  of  the  ultimate 
consumer; 

3.  by  presenting  these  concepts  as  a  first  itera¬ 
tion,  to  stimulate  an  active  dialogue  within 
the  environmental-acoustics  community  resulting 
in  an  improvement  in  the  area-assessment  process. 

The  reader  should  not  be  tempted  to  conclude  that  by  des¬ 
cribing  the  approach,  AKSD  has  reduced  it  to  a  sequence  of 


mechanical  operations.  While  the  converting  of  measured 
data  and  modeling  insight  into  useful  systems  information 
is  an  advanced  development  program,  it  is  closer  to  research 
in  terms  of  the  techniques  employed.  Any  attempt  to  elimin¬ 
ate  this  type  of  analysis  from  the  process  would  signifi¬ 
cantly  degrade  the  value  of  the  product  to  the  Navy. 

The  following  section  describes  more  fully  the  tech¬ 
niques  and  products  of  an  acoustic  area  assessment,  first 
in  the  general  context  of  a  LRAPP  exercise,  and  then  in 
the  more  restricted  application  to  a  particular  system, 
this  background,  Section  3  relates  area  assessment 
the  generation  of  acoustic  parameters  for  a  particular 
system  study.  Unless  the  desired  quantities  have  been 
measured  for  the  precise,  required  conditions,  even  the 
simplest  application  of  measured  results  represents  im- 
plicitelv  a  "model".  In  this  report,  then  modeling  is 
taken  in  its  most  general  sense  as  a  means  for  extrapolating 
and  interpolating  from  observed  results.  The  objective 
is  tc  provide  the  best  estimate,  as  defined  by  the  state- 
of-the-art  and  within  the  limitations  of  available  re¬ 
sources,  whether  by  a  totally  automated  computer  code 
based  upon  first  principles,  or  by  a  simple  extension  of 
measurements. 


The  subsequent  section  describes  the  development  of 
this  modeling  capability,  an  integral  part  of  which  is  the 
quantitative  calibration  of  absolute  model  accuracy.  The 
uncertainty  associated  with  a  particular  prediction  is 
shown  to  stem  from  inaccuracies  in  the  environmental  as 
veil  as  the  acoustic  models,  and  may  also  be  made  to  re¬ 
flect  user-specified  ranges  in  parameters  such  as  source 
or  receiver  depths,  frequency',  etc. 

A  companion  report  will  summarise  the  status  of  the 
acoustic  and  environmental  models  available  to  AESD  and 
will  be  updated  periodically  to  reflect  changes  in  that 


status.  While  one  of  AESD's  missions  is  to  synthesize 
Navy  Standard  Models,  another  is  to  provide  those  acoustic 
inputs  needed  by  the  systems-engineering  community.  The 
requirement  for  the  best  possible  estimate  may  lead  to  the 
present  Navy  Standard  Model,  or  it  may  suggest  application 
of  other  models  in  the  advanced  development  stage  available 
at  AESD,  but  not  yet  approved  as  Navy  Standards.  The 
careful  exercise  of  these  developmental  models  at  AESD, 
by  those  involved  in  their  development  and  familiar  with 
their  limitations,  may  produce  the  best  results. 

The  discussion  of  these  models,  as  well  as  the  Navy 
Standard  Models  and  the  environmental  models,  is  intended 
to  acquaint  the  systems  engineer  and  experimental  designer 
with  some  of  the  additional  capabilities  which  might  be 
applicable  to  his  problem.  The  specific  model  to  be 
applied  tc.  answer  a  particular  question  should  be  selected 
by  AESD  and  the  investigator  after  joint  consideration  of 
the  actual  question  being  addressed.  The  independent 
translation  by  the  investigator  of  his  question  <m 

«$4MMariNMM»  into  a  request  for  a  number  of  model  runs  has  been 
found  tc  be  a  particularly  inefficient,  and  in  many  cases 
futile,  process. 


2.0 


RESULTS  OF  ACOUSTIC  AREA  ASSESSMENT 


The  ultimate  product  of  an  acoustic  area  assessment  is 
a  capability  to  provide  relevant,  calibrated  acoustic  inputs 
for  a  particular  area.  Much  of  the  capability  is  passed  on 
directly  to  the  user  in  the  form  of  a  report  describing  the 
appropriate  environmental  factors  for  his  system,  and  the 
corresponding  acoustic  models.  If  the  model  encompasses 
large  computer  codes,  these  will  remain  at  AESD  and  be 
exercised  upon  request.  In  many  cases,  however,  the  sensi¬ 
tivity  of  the  model  to  parameter  changes  can  be  described 
in  the  report,  thereby  avoiding  extensive  computer  runs. 

In  fewer  cases  an  approximate,  but  sufficiently  accurate 
quantitative  model  is  included  which  the  user  can  exercise 
himself  within  limits  on  the  geometry  and  the  environment 
provided  by  AESD. 

2 . 1  Multiple-System  Assessments 

In  the  case  of  the  LRAPP  exercise,  the  individual  sys¬ 
tem  reports  are  preceded  by  a  summary  assessment  report 
directed  towards  many  possible  systems,  which  provides  a 
general  discussion  of  the  environmental  and  acoustic  pro¬ 
perties,  and  of  the  ability  of  our  models  to  predict  in 
this  area.  This  report  forms  the  basis  for  the  individual 
system-assessment  reports  to  be  described  in  the  following 
subsection.  The  purpose  of  this  summary  report  is  to  act 
as  the  first  filter  on  the  experimental  data  and  to  make 
the  first  combination  of  the  pre-exercise,  or  archival, 
data  with  the  exercise  results. 

The  summary  report  addresses,  at  a  minimum,  the  following 
topics : 

1.  Available  oceanographic  models  for  the  area  in¬ 
cluding  their  resolution,  calibration,  and 
interface  capabilities  with  appropriate  acoustic 
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models.  Oceanographic  factors  discussed  are: 
four-dimensional  sound-speed  structure?  bathy¬ 
metry;  bottom  reflectivity;  and  wind-speed/ 
wave-height  information. 

2.  Additional  environmental  data  from  a  wider  geo¬ 
graphic  area  pertinent  to  the  ambient  noise  field 
within  the  area:  ship  densities;  shipping 
routes;  and  distant  bathymetric  features,  such 

as  continental  slopes. 

3.  Acoustic  propagation  and  noise  models  relevant 
to  the  area,  including:  estimates  of  their 
accuracy  from  previous  evaluations  and  compari¬ 
sons  with  exercise  data;  their  resolution  and 
applicability  to  particular  oceanographic 
features  of  the  area;  the  relative  efforts  in¬ 
volved  in  their  execution;  and  any  particularly 
weak  areas  in  the  overall  modeling  capability. 

4.  A  discussion  of  the  relative  influences  of 
oceanographic  features  on  classes  of  systems 
which  may  be  differentiated  in  terms  of  their 
response  to  the  environment. 

5.  A  discussion  of  those  environmental  and  acoustic 
factors  which  have  been  missed  or  undersampled 
in  this  exercise,  leading  to  critical  gaps  or 
unacceptable  uncertainties  in  the  resulting 
area-assessment  capability.  This  information 
should  impact  the  design  of  future  measurement 
programs . 

The  fourth  item  in  this  list  considers  only  a  limited  class 
of  systems  in  terms  of  their  relative  sensitivity.  The 
specific  discussions  of  the  acoustic  environment  appropriate 
to  these  systems,  and  others,  are  reserved  for  the  subse¬ 
quent  system-oriented  assessment  reports. 
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2 . 2  Individual-System  Assessment 

The  first  step  in  generating  an  individual-system  assess¬ 
ment  report  is  to  distill  from  the  multiple-system  report 
the  information  relevant  to  a  single  system.  This  informa¬ 
tion  is  then  augmented  by  all  available  data  and  leads  to 
an  absolute  measure  of  system  sensitivity  to  the  acoustic 
environment  rather  than  the  relative  sensitivity  discussed 
in  the  multiple-system  assessment.  It  is  in  this  report 
that  the  specific  system-oriented  environmental  and  acoustic 
models  are  formulated  and  calibrated.  The  degree  of  inter¬ 
action  between  the  acoustician  and  systems  engineer  is 
multiplied  many-fold  in  this  phase  over  that  required  in 
the  summary-assessment.  At  this  point  the  systems  engineer 
must  define  how  his  system  (or  at  least  his  model  for  the 
system)  works,  in  sufficient  detail  to  permit  the  acous¬ 
tician  tc  formulate  the  meaningful  acoustics  questions. 

This  is  an  iterative  process  in  which  both  participants 
exchange  relevant  information  and  understanding. 

The  report  represents  a  collaborative  effort  and 
provides  the  systems  engineer  with  the  capability  to  per¬ 
form  at  least  some  of  his  sensitivity  studies  without 
exercising  expensive  computer  codes.  The  information  pro¬ 
vided  to  the  acoustician  should  highlight  weaknesses  in 
both  experimental  design  and  his  acoustic-modeling  capability 
The  specific  contents  of  a  system  report  are  not  enumerated 
here  since  they  vary  substantially  from  system  to  system. 
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ACOUSTIC  PARAMETERS  FOP  SYSTEM  PERFORMANCE  ESTIMATION 


The  competition  for  limited  resources  between  a  number 
of  existing  and  proposed  acoustic  systems  in  an  area  re¬ 
quires  the  ability  to  quantitatively  assess  system  perfor¬ 
mance  against  present  and  projected  threats.  With  the 
advent  of  automatic  detectors,  the  detection  process  is  a 
defined,  modelable  process,  given  the  input  signal-to-noise 
ratio.  Models  have  been  developed  for  these,  as  well  as  the 
less  deterministic  detectors,  v/hich  when  married  with  higher 
level  engagement  models  permit  an  assessment  of  system  per¬ 
formance.  A  derailed  defense  of  the  need  for  such  models 
is  not  attempted  here;  but  clearly  one  cannot,  measure  the 
performance  of  a  non-existent  system  against  a  projected 
threat.  Even  for  existing,  deployed  systems,  the  cost  of 
measuring  system  performance  with  calibrated  simulation 
threats  is  prohibitive.  While  the  systems  engineer  defines 
the  V-  at  and  the  processing  techniques,  the  properties  of 
the  received  signal  and  the  masking  background,  or  noise, 
lie  in  the  domain  of  the  acoustician.  'Hie  generation  of 
these  acoustic  inputs  is  the  subject  of  this  section. 

Figure  3-1  illustrates  the  relationship  between  perfor¬ 
mance  prediction  and  the  generation  of  acoustic  parameters. 
The  desired  acoustic  parameter,  Y_,  may  be  transmission 
loss,  noise,  or  any  of  a  number  of  properties  and  depends 
on  parameters,  yv,  including  both  geometric  factors,  (range, 
depth,  etc.)  and  the  environment.  In  the  very  unlikely 
event  that  the  precise  desired  parameter  has  been  measured 
for  the  precise  geometry  and  environment  specified,  the 
measured  value,  Y  ,  is  provided.  If  this  route  is  not 
available,  the  parameter  must  be  modeled. 

The  modeled  value  represents  the  best  estimate  obtain¬ 
able  within  the  constraints  of  available  resources  and  the 
required  accuracy  of  the  estimate  as  specified  by  the  user. 
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FIGURE  3-1.  Relationship  Between  Performance,  Prediction 
and  Generation  of  Acoustic  Parameters 


Wherever  possible  and  cost-effective,  fully  automated 
computer  codes  will  be  employed.  The  advanced  development 
effort  at  AESD  has  as  its  major  objective  the  synthesis  of 
models  which  are  fully  automated  and  sufficiently  accurate 
for  a  wide  spectrum  of  applications.  Where  computer  codes 
are  not  employed,  the  model  used  is  documented  so  that  the 
results  provided  are  repeatable  and  may  be  consistently 
expanded  upon  at  a  later  date. 

In  the  latter  cases  the  "model"  may  vary  from  a  direct 
interpolation  in  data  to  the  use  of  the  computer-code  model 
to  determine  only  relative  differences  which  are  then  added 
to  the  measured  data.  In  all  events  some  measure  of  the 
accuracy  of  the  modeled  value  is  provided  as  well  as  its 
sensitivity  to  parameter  variation.  This  sensitivity 
analysis  can  frequently  be  used  to  avoid  additional  model 
runs,  reducing  the  overall  cost  and  permitting  the  applica¬ 
tion  of  more  powerful  models  to  fewer  cases. 

Figure  3-2  illustrates  the  modeling  process  and  reempha¬ 
sizes  the  required  interaction  between  the  systems  engineer 
and  the  acoustician.  Assuming  that  the  quantity  has  not 
been  measured  under  the  precise  specified  conditions,  the 
procedure  involves  the  selection  of  an  appropriate  com¬ 
puter  code  as  a  candidate  predictor.  This  selection  combines 
the  accumulated  prior  knowledge  of  model  accuracy  with  the 
evaluation  associated  with  the  LRAPP  exercise,  if  available, 
and  with  the  system  sensitivity  and  accuracy  requirements 
provided  by  the  systems  engineer.  From  the  exercise  and 

archival  data  banks,  measurements  (Y_)  which  are  "close"  to 

J 

the  desired  quantity  in  terms  of  geometry  and  environment 

are  selected  along  with  their  associated  conditions  (y  ) . 

m 

The  selected  code  is  executed  under  these  conditions 
and  the  predicted  values  are  compared  with  the  measured  to 
assess  model  accuracy.  The  decision  on  the  adequacy  of 
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FIGURE  3-2.  "Modeling"  Acoustic  Parameters 


the  model  must  be  made  by  the  systems  engineer  in  conjunc¬ 
tion  with  the  acoustician.  If  the  model  accuracy  is 
unacceptable ,  a  branch  not  indicated  in  the  figure  considers 
the  selection  of  a  more  powerful  model  which  may  require  a 
reduction  by  the  systems  engineer  in  the  number  of  runs 
requested.  The  process  is  repeated  until  either  an  accept¬ 
able  model  is  found  (at  which  time  it  is  exercised  with 
the  desired  conditions  (y.)  to  provide  a  prediction),  or  it 
is  determined  that  no  computer  code  can  provide  the  desired 
results  within  the  resource  constraints.  At  this  point  the 
type  of  interpolation  described  above,  based  upon  the  models 
and  data,  is  performed  to  provide  the  prediction.  Since  the 
interpolation  process  is  likely  to  be  more  costly  than 
executing  the  computer  codes,  the  systems  analyst  may  again 
be  required  to  reduce  the  number  of  estimates  required. 

This  iterative,  inter-active  process  is  required  to  ensure 
tha4-  model  predictions  have  an  accuracy  satisfactory  to  the 
systems  engineer. 
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4.0  ACOUSTIC  AREA  ASSESSMENT 

The  development  of  this  predictive  capability  is  the 
objective  of  acoustic  area  assessment.  The  assessment 
process  is  described  in  this  section  in  the  context  of  a 
LRAPP  exercise  and  consists  of  four  basic  phases: 

1.  The  pre-exercise  phase  which  leads  to  certain 
requirements  on  the  exercise  program; 

2.  The  post-exercise  phase  in  which  an  intensive 
analysis  of  the  experimental  data  leads  to 
area-wide  environmental  and  acoustic  models; 

3.  The  evaluation  phase  which  calibrates  both 
models ; 

4.  The  prediction  phase  as  already  described. 

In  the  absence  of  a  LRAPP  exercise,  other  available  archival 
data  are  examined,  and  phases  2  through  4  are  executed. 

The  systems  emphasis  in  these  phases  shifts  from  multiple 
to  individual  systems  as  the  process  progresses.  The 
summary-assessment  report  stops  at  phase  3,  while  the 
individual-assessment  report  involves  phases  2  through  4. 
Figure  4-1  expands  upon  this  concept  and  serves  as  the 
basis  for  the  discussion  in  the  following  subsections. 

4 . 1  Phase  1  -  Prc-Rxercisc 

Given  that  a  set  of  environmental-acoustic  measurements 
will  be  made  in  a  particular  area,  the  first  step  is  to 
assess  the  adequacy  of  existing  environmental  and  ?oustic 
models  for  that  area  with  respect,  to  the  needs  of  present 
and  envisioned  acoustic  systems.  In  order  to  perform  an 
acoustic  area  assessment  for  a  number  of  systems,  a  deter¬ 
mination  must  be  made  of  first,  those  environmental  factors 
which  critically  influence  each  system's  performance,  and 
second,  what  additional  measurements  are  required  to  provide* 
an  environmental  data  base  and  an  acoustic  model  calibration 
of  sufficient  accuracy  to  anticipate  the  systems  requirements. 


In  this  process  selected  models  are  exercised  with 
inputs  varying  within  the  environmental  uncertainties  and 
in  geometries  associated  with  different  classes  of  systems. 
Unusual  oceanographic  features  are  identified  to  determine 
environmental-measurement  requirements,  and  to  alert  the 
experimental  designer  to  unusual  regimes  which  may  require 
extraordinary  measurement  procedures. 

The  end-result  of  this  process  is  the  generation  of 
requirements  for  two  classes  of  measurements.  Regional 
measurements  are  intended  to  address  gaps  in  the  environ¬ 
mental  models  for  the  area.  Some  may  be  direct  oceano¬ 
graphic  measurements  (sound-speed  profiles,  etc.),  others 
direct  measurements  of  other  environmental  factors  (ship 
densities,  etc.),  and  still  others  may  be  acoustic  measure¬ 
ments  from  which  environmental  parameters  are  inferred. 

For  example,  while  area-wide  detailed  reflectivity  measure¬ 
ments  such  as  those  acquired  by  NOO  and  NADC  may  not  be 
feasible,  gross  reflectivity  samples  may  be  obtainable  by 
the  analysis  of  a  number  of  shots  on  a  number  of  different 
sensors,  considerably  expanding  the  bottom- ref lectivity 
data-base  in  this  area. 

The  second  class  of  measurements  consists  of  at  most  a 
few  sets  of  high-resolution  (fine-grain)  environmental  and 
acoustic  measurements.  These  measurements  form  the  basis 
for  subsequent  model  evaluation.  The  hope  is  to  make  them 
with  sufficient  accuracy  in  geometry,  environmental  sampling 
and  data  reduction  techniques  that  experimental  errors  are 
negligible,  thus  permitting  the  extraction  of  the  actual 
model  error.  These  measurements  focus  on  critical,  untested 
aspects  of  the  acoustic  models.  The  concurrent  oceano¬ 
graphic  measurements  are  required  by  the  acoustic  models 
and  are  also  used  to  calibrate  the  area-wide  environmental 
mode  1 s . 
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4  •  2  Phase  2  -  Model  Development 

The  first  post-exercise  phase  consists  of  a  period  of 
intensive  data  analysis  and  interpretation  leading  to  the 
assembling  of  the  environmental  and  acoustic  models  for 
the  area.  The  fine-grain  acoustic  data  are  examined, 
using  models  as  tools,  for  features  indicating  physical 
mechanisms  which  are  either  missing  from  or  mistreated  in 
the  models,  and  which  may  have  significant  implications  for 
particular  systems.  The  appropriate  acoustic  model  for  a 
system  may  be  highly  dependent  upon  this  analysis.  The 
measurements  selected  for  detailed  model-evaluation  studies 
also  are  determined  at  this  stage. 

In  this  phase  AESD  requires  a  limited  in-house  or  local 
data-processing  capability  to  analyze  selected  segments  of 
data  in  non-standard  ways  (digital  arrival  structure,  very 
narrow-band  analysis,  cross-correlation  between  hydrophones, 
etc.).  The  precise  data  to  be  analyzed  cannot  be  specified 
until  the  standard  data  are  examined,  and  the  processing 
techniques  must  be  adapted  to  each  situation  as  the  analysis 
progresses.  Hence  it  is  impossible  to  include  the  processing 
of  these  data  sets  in  the  routine  data  reduction. 

The  environmental  information  obtained  through  this 
analysis  is  combined  with  the  area-wide  measurements  and 
the  archival  environmental  data  to  form  the  area-wide 
environmental  models.  In  addition  to  the  types  of  environ¬ 
mental  data  referred  to  earlier,  it  may  be  possible  to 
simplify  the  dependence  of  some  systems  to  a  processed 
subset  of  the  overall  environment,  such  as  mixed-layer  depth, 
surface  sound-speed,  or  depth  excess.  These  simpler  environ¬ 
mental  models  frequently  provide  new  insight  into  the 
sensitivity  of  system  performance  to  environmental  parameters. 
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4.3 


Phase  3  -  Modal  Evaluation 


In  the  model  evaluation  phase  the  accuracy  and  resolu¬ 
tion  of  both  the  acoustic  and  environmental  models  for  the 
area  are  estimated.  The  accuracies  of  both  models  are 
required  to  estimate  the  accuracy  or  variability  of  a  pre¬ 
diction.  In  particular,  if  we  take  as  an  example  the  modeling  ' 

of  transmission  loss,  a  prediction  may  have  errors  asso¬ 
ciated  with  the  estimates  of  the  environment  as  well  as  the 
fundamental  accuracy  of  the  acoustic  model. 

4.3.1  Environmental  Model  Evaluation 

The  environmental  model  evaluation  compares  estimates 
of  the  environment  obtained  from  the  four-dimensicnal 

(position  and  time)  fields  and  compares  them  with  the  f 

detailed  fine-grain  measurements  collected  in  the  exercise. 

Differences  may  be  attributed  to  combinations  of  field 
resolution,  field  interpolation  algorithms  and,  since  all 

current  environmental  models  assume  repeatability  from  f 

year  to  year,  the  variations  in  the  environment  at  one 
position  and  time  of  year  to  the  same  position  and  time  in 
a  afferent  year.  These  observed  differences  indicate 

possible  spreads  between  predicted  and  actual  environments  f 

and  produce  through  the  acoustic  model  a  corresponding 
variation  in  the  prediction. 

4.3.2  Acoustic  Model  Evaluation  f 

The  accuracy  of  acoustic  models  has  advanced  to  the 

point  that,  in  evaluating  acoustic  model  error,  measurement 
uncertainties  must  be  considered.  If,  in  the  example  of 

transmission  loss,  we  define  the  model  error,  to  be  f 

the  difference  between  predicted  (TLp)  and  actual  (TL) 
transmission  loss  under  identical  conditions,  then 

< 
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eMOD(X>  =  TLp(X)-TL(X) 


(4-1) 


where  X  is  a  multi-dimensional  variable  upon  which  trans¬ 
mission  loss  depends.  In  particular 

X  =  (ENV, Z)  (4-2) 


where  ENV  represents  all  environmental  influences,  and  Z 
represents  the  source-receiver  geometry  within  the  environ¬ 
ment.  Any  averaging  or  integration  contained  in  the 
measurement  (i.e.  time  averages  in  CW  data,  or  third- 
octave  processing  in  shot  data)  must,  of  course,  be  simu¬ 
lated  in  the  model. 

Letting  the  subscript  M  denote  a  measured  or  reported 
value,  then  we  may  rewrite  Equation  4-1,  by  adding  and 
subtracting  similar  terms,  to  obtain 

eMOD(X)  '  [TLp(X)-TLp(XM))+|TLp(XM)-TLM(X)] 

■MTL  (X)-TL(X)  ]  (4-3) 

M 

or 


WX)  '  'iN^'V+W^V+'W30  (4-4> 


The  model  error,  then,  consists  of  three  (not  independent) 


terms. 


The  second  term,  is  the  difference  between 


the  predicted  and  measured  values  and  has  frequently  been 
confused  with  model  error.  For  models  of  low  accuracy  it 
dominates  the  other  two  terms  and  may  reasonably  approx¬ 


imate  The  first  term,  eTM,  reflects  the  difference 

between  the  predicted  value  for  the  actual  geometry  and 
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environment,  and  the  predicted  value  for  the  reported 
geometry  and  environment  (denoted  by  X^) .  Hence  it  reflects 
model  sensitivity  to  errors  in  inputs.  The  largest  such 
errors  in  current  measurements  are  associated  with  source 
ranges  and  depths.  The  third  term,  eps>  reflects  the 
difference  between  the  actual  and  measured  values  of 
transmission  loss.  Errors  here  may  be  associated  with 
source  levels  (especially  for  shots)/  hydrophone  sensi¬ 
tivities,  and  analysis  techniques. 

The  objective  in  mod'-l  evaluation  is  to  determine  the 
probability  of  a  particular  vaiue  of  model  error,  given 
the  set  of  observed  errors,  that  is  P  (£.,._  I  e^_)  .  This 
requires  estimates,  from  those  involved  in  the  measurement, 
of  uncertainties  in  all  measured  and  reported  values. 

Since 


IN' 


MOD'  and  CPS  are  n0t  independent,  the  approaches 


used  in  the  construction  of  the  distribution  of  are 

sufficiently  complex  to  be  beyond  the  scope  of  this  report. 
The  application  of  this  technique  to  comparisons  of  PARKA 
Data  and  predictions  using  AESD’s  most  powerful  transmission- 
loss  model,  the  Parabolic  Equation  Model,  indicated  that 
errors  associated  with  the  measurement  process,  in  partic¬ 
ular  source  range  and  source  level,  were  competitive  with 
the  apparent  model  error  for  RR  and  RSR  paths.  Hence  the 
observed  error  consists  of  nearly  equal  parts  measurement 
and  model  error. 


4.3,?  Experimental  Con s i dor at  ions 

These  considerations  have  several  implications 
experiment  design..  In  the  presence  of  experiment;* 
even  a  perfect  model  will  yield  an  observed  error 
’  will  not  be  identically  zero).  Alternatively, 
the  predicted  and  measured  values  agreed  precisely 


:or 


i  error, 

( ths  t  is, 
even  i f 
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the  estimate  of  model  error  will  be  limited  by  the  remaining 
uncertainties  in  eT.7  and  enc.  That  is  P  (e.,-.J  e,=0)  will 
have  a  distribution  driven  by  measurement  errors.  If  the 
distribution  suggests  a  model  error  which  is  unacceptable 
for  the  application  of  this  model  to  a  particular  system 
question,  then  this  experiment  cannot  be  used  to  decide 
whether  the  model  has  sufficient  accuracy.  Note  that  this 
inference  can  be  made  prior  to  the  experiment  if  a  priori 
estimates  of  geometry,  environment,  and  processing  errors 
are  supplied  by  the  experimentalist.  This  type  of  pre¬ 
exercise  planning  with  the  aid  of  models  is  critical  to 
ensuring  the  usefulness  of  measured  results  in  assessing 
model  accuracy.  A  particularly  inefficient  use  of  modeling 
resources,  which  serves  no  useful  purpose,  is  the  pre¬ 
exercise  prediction  of  results  for  all  planned  measurements. 


4. 4  Prediction  Accuracy 

Given  evaluated  acoustic  and  oceanographic  models,  it 
is  now  possible  to  provide  acoustic  predictions  with  mea¬ 
sures  of  the  uncertainties  associated  with  both  the  environ¬ 
mental  and  acoustic  models.  If  the  error  in  the  prediction, 

is  defined  by 
PRED  J 


ePRED  “  TLp(Xp,-TL(X) 


(4-4) 


where  the  error  in  input  is  solely  environmental. 


Xp  =  (ENVp,Z) 


(4-5) 


then 


PRED 


=  (TLp(Xp)-TLp(X)]+[TLp(X)-TL(X)] 


“  eENV(XP'X)+CM0D(X) 


(4-6) 
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and  the  sensitivity  of  the  prediction  to  the  environmental 
uncertainty,  £„.„_,  may  be  combined  with  the  model  error  to 
obtain  the  prediction  error*  An  example  of  a  statement  of 
prediction  error  might  be  that  the  predicted  losses  have 
errors  of  less  than  3  dB  90  per  cent  of  the  time. 

This  procedure  can  be  extended  to  include  in  the  pre¬ 
diction  uncertainty  the  variations  associated  with  spec¬ 
ified  ranges  in  geometric  factors  (Z)  such  as  source  depth. 
The  above  techniques  can  also  be  applied  beyond  this  example 
of  transmission  loss  to  other  acoustic  parameters  such  as 
convergence-zone  levels  and  ranges,  or  the  fraction  of  range 
with  loss  less  than  a  certain  value,  or  ambient  noise  level, 
or  signal-to-noise  ratio.  While  the  uncertainties  associated 
with  loss  versus  range  may  appear  substantial,  the  corres¬ 
ponding  uncertainty  in  detection-related  quantities  may  be 
much  less.  In  some  instances  it  may  be  cost  effective  to 
apply  the  techniques  directly  to  quanties  like  probability 
of  detection  by  functionally  relating  them  to  the  acoustic 
variables . 


*~~  Frequently,  environmental  models  are  based  upon  measure¬ 
ments  themselves,  perhaps  in  the  same  month  and  location  as  *• 

the  fine-grain  measurement,  but  in  a  different  year.  Since 
neither  environment  is  "in  error"  in  this  case,  eENV  may 

more  accurately  be  considered  as  a  measure  of  the  variation 
in  conditions  expected  at  this  location  from  year  to  year. 
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sow**. 


5.0 


SUMMARY 


This  report  reflects  a  program  at  AESD  to  coordinate 
the  process  of  acoustic  area  assessment  from  the  pre¬ 
exercise  phase  through  the  delivery  of  acoustic  parameters 
relevant  to  a  specific  system.  The  utility  of  the  results 
of  future  measurement  programs  in  the  assessment  process 
depends  critically  upon  the  extent  to  which  the  experi¬ 
mental  design  addresses  those  model  deficiencies  which  have 
the  highest  impact  on  the  ability  to  predict  system  per¬ 
formance.  A  high  degree  of  coordination  and  communication 
is  required  between  the  measuring,  modeling  and  systems- 
engineering  communities. 

While  the  acoustic  area  assessment  process  functions 
best  in  conjunction  with  a  measurement  program,  the  cap¬ 
ability  can  be  developed  for  any  area  and  system.  By  this 
process  the  systems  engineer  is  provided  with  state-of- 
the-art  estimates  within  the  usual  resource  constraints. 
Included  with  these  acoustic  parameters  are  estimates  of 
their  accuracy,  permitting  the  systems  engineer  to  estimate 
the  true  significance  of  predicted  differences  in  system 
performance . 
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